FAST 3D HEIGHT MEASUREMENT METHOD AND SYSTEM 

FIELD OF THE INVENTION 

[001] The present invention relates to measurement systems and methods. More 
specially, the present invention is concerned with a fast 3D height 
measurement system and method based on the FMI method. 

BACKGROUND OF THE INVENTION 

[002] The use of interferometric methods for three-dimensional inspection of an 
object or to measure the variations of height (relief) of an object is well 
known. These methods generally consist in generating an interferometric 
image (or interferogram) to obtain the relief of the object. The interferometric 
image generally includes a series of black and white fringes. 

[003] In "classic interferometric methods", which require the use of a laser to 
generate the interferometric pattern, the wavelength of the laser and the 
configuration of the measuring assembly generally determine the period of 
the resulting interferogram. Classic interferometry methods are generally 
used in the visible spectrum to measure height variations in the order of the 
micron. However, there has been difficulty in using such a method to 
measure height variations on a surface showing variations in the order of 0.5- 
1mm when they are implemented in the visible spectrum. Indeed, the 
density of the black and white fringes of the resulting interferogram 
increases, causing the analysis to be tedious. Another drawback of classic 
interferometric methods is that they require measuring assemblies that are 
particularly sensitive to noise and vibrations. 

[004] Recently, three-dimensional inspection methods based on Moire 
interferometry have been developed for a more accurate measurement of the 
object in the visible spectrum. These methods are based on the analysis of 
the frequency beats obtained between 1) a grid positioned over the object to 
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be measured and its shadow on the object ("Shadow Moire Techniques") or 
2) the projection of a grid on the object, with another grid positioned between 
the object and the camera that is used to photograph the resulting 
interferogram ("Projected Moire Techniques"). In both cases, the frequency 
beats between the two grids produce the fringes of the resulting 
interferogram. On one hand, a drawback of the Shadow Moire technique for 
measuring the relief of an object is that the grid must be very closely 
positioned to the object in order to yield accurate results, causing restrictions 
in the set-up of the measuring assembly. On the other hand, a drawback of 
the Projected Moire technique is that it involves many adjustments, and 
therefore generally produces inaccurate results since it requires the 
positioning and tracking of the two girds; furthermore, the second grid tends 
to obscure the camera, preventing it from being used simultaneously to take 
other measurements. 

[005] Interestingly, methods based on "phase-shifting" interferometry allow 
measurement of the relief of an object by analyzing the phase variations of a 
plurality of images of the object after projections of a pattern thereto. Each 
image corresponds to a variation of the position of the grid, or of any other 
means producing the pattern, relative to the object. Indeed, the intensity 
l(x,y) for every pixel (x,y) on an interferometric image may be described by 
the following equation: 

l(x,y) = A(x,y) + B(x,y)cos(A0(x,y)) (1) 

where A& is the phase variation (or phase modulation), and A and B are a 
coefficients that can be compute for every pixel. 
[006] In the PCT application No. WO 01/06210, entitled "Method And System For 
Measuring The Relief Of An Object", Coulombe et ai describe a method and 
a system for measuring the height of an object using at least three 
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interferometric images. Indeed, since Equation 1 comprises three unknowns, 
that is A, B and A0, three intensity values l 1f l 2 and l 3 for each pixel, 
therefore three images are required to compute the phase variation A0. 
Knowing the phase variation AO, the object height distribution 1 at every 
point z(x,y) relative to a reference surface 2 can be computed using the 
following equation: 



where p is the grid pitch and 0 is the projection angle, as described 
hereinabove and as illustrated in Figure 1. 

[007] A drawback of such a system is that it requires moving the grid between 
each take of images, increasing the image acquisition time. This can be 
particularly detrimental, for example, when such a system is used to inspect 
moving objects on a production line. More generally, any moving parts in 
such systems increase the possibility of imprecision and also of breakage. 

[008] Moreover, such systems and method prove to be lengthy, in particular 
considering the time required for acquiring at least three images. 

[009] A method and a system for measuring the height of an object free of the 
above-mentioned drawbacks of the prior-art is thus desirable. 



OBJECTS OF THE INVENTION 

[010] An object of the present invention is therefore to provide an improved 3D 

height measurement method and system. 
[011] Other objects, advantages and features of the present invention will become 

more apparent upon reading of the following non-restrictive description of 

specific embodiments thereof, given by way of example only with reference 

to the accompanying drawings. 
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SUMMARY OF THE INVENTION 

[012] More specially, in accordance with the present invention, there is provided a 
Fast Moire Interferometry (FMI) method and system for measuring the 
dimensions of a 3D object using only two images thereof. The method and 
the system perform the height mapping of the object or the height mapping of 
a portion of the object with respect to a reference surface. The present 
invention can be used to assess the quality of the surface of an object that is 
under inspection. It can also be used to evaluate the volume of the object 
under inspection. 

[013] The method for performing a height mapping of the object with respect to a 
reference surface comprises obtaining a first intensity characterizing the 
object, the object on which is projected an intensity pattern characterized by 
a fringe contrast function M(x,y), and the intensity pattern being located at a 
first position relatively to the object; obtaining a second intensity 
characterizing the object, the object on which is projected the intensity 
pattern at a second position shifted from the first position; calculating a phase 
value characterizing the object using said intensities and said fringe contrast 
function M(x,y); and obtaining the height mapping of the object by comparing 
the phase value to a reference phase value associated to the reference 
surface. 

[014] The method can further comprise obtaining the height mapping of a portion 
of an object, the portion corresponding to a layer of the object. 

[015] The method can further comprise evaluating the volume of an object from its 
height mapping. 

[016] The method can further comprise determining a difference between the 
height mapping of object and a reference height mapping value, and using 
this difference to assess the quality of the object. 

[017] The system for performing a height mapping of the object with respect to a 
reference surface comprises a pattern projection assembly for projecting, 
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onto the object, an intensity pattern characterized by a given fringe contrast 
function M(x,y); displacement means for positioning, at selected positions, 
the intensity pattern relative to the object; and a detection assembly for 
acquiring an intensity characterizing the object for each selected positions of 
said pattern relative to the object. Finally the system comprises computing 
means for calculating a phase value characterizing the object using the 
intensity acquired for each selected positions; and further determining the 
height mapping of the object by comparing the phase value to a reference 
phase value associated to the reference surface. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[01 8] In the appended drawings: 

[019] Figure 1, which is labeled prior art, is a schematic view of a phase-stepping 

profilometry system as known in the prior art; 
[020] Figure 2 is a flowchart of a method for performing a height mapping of an 

object according to an embodiment of the present invention; 
[021] Figure 3 is schematic view of the system for performing the height mapping 

of an object according to an embodiment of the present invention. 
[022] Figure 4 is a block diagram describing the relations between the system 

components and a controller according to an embodiment of the present 

invention. 

DESCRIPTION OF THE SPECIFIC EMBODIMENT 

[023] Generally stated, the present invention provides a Fast Moire Interferometry 
(FMI) method for measuring dimensions of a 3D object using only two 
images thereof. In the present embodiment we will focus on a phase-shifting 
profilometry method using visible light source and a digital camera to acquire 
those two images. 

[024] In the present embodiment, a grid pattern is projected onto an object 3 as 
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illustrated in Figure 3. Because of an angle 6 between the projection and 
detection axes, the intensity of the projected grating varies both on horizontal 
(x) and vertical (z) direction. In the present embodiment the intensity of the 
projected grating onto the object corresponds to sinusoidal projected fringes, 
and can be described as follows: 



/(*, y) = R(x 9 y)- [l + M(x,y) • Cos{k x x + k y • y + k 2 • z{x 9 y)+ % + S i )] 

where l(x,y) is the light intensity at the object coordinates {x,y}\ R(x,y) is 
proportional to the object reflectance and light source intensity; M{x,y) is a 
fringe contrast function; k x , k y and k z are the fringe spatial frequencies near 
the target, <p 0 is a phase offset constant. By acquiring the intensity l{x,y) 

using for example a CCD camera, an image of the object can be obtained. 
[025] The FMI method is based on the difference of the phase value on an 
inspected <p t9Kgei (x 9 y) and referenced <p ref {x,y) surfaces. This difference is 

usually calculated point by point and yields the object height mapping, 
z(x,y) t for each point {x,y}: 

<Pre f {x 9 y) = k x -x + k y -y + k z - z ref (x,y)+<p Q (5) 

Z (*> y) = ^rarger { X > y) ~ * ref ( X > y) = J~ ' (<Pt* g et (*> ^) " <Pref ( X > ^)) (6) 

where the coefficient k z represents the spatial grating frequency in the z 
direction and can be obtained from system geometry or from calibration with 
an object of known height. 
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[026] Then, a phase-shifting technique is applied in order to determine the phase 
values for each point <p(x,y). The phase-shifting technique consists in 
shifting the pattern relatively to the object in order to create a phase-shifted 
intensity l(x,y) or image. At least three different phase-shifted images, 
obtained with three phase-shifted projected patterns, are required in order to 
solve a system with 3 unknowns, namely R(x,y) y M(x,y), and cp{x,y), 
yielding the phase value. For example, in a simple case of four phase steps 
of nil the system takes the following form: 

' I a (x, y) = R(x, y)-[\ + M{x, y) • Cos{<p{x, y))] 
^ I b (x, y) = R(x, y) ■ [l + M(x, y) • Cos{<p(x, y)+nll)] 
' lXx,yhR(x,y)il + M(x,y)-Cos{<p(x,y)+7r)] 

I d (x, y) = R(x, y) • [l + M(x, y) ■ Cos{<p{x, y) + 3tt 1 2)\ 

and can be resolved as follows: 

<p{x,y)=tg 

[027] The method of the present invention takes advantage of the fact that while 
the R(x,y) parameter is determined by lighting intensity, optical system 

sensitivity, and object reflectance, and therefore can vary during inspection of 
different object, on the contrary, the value of the fringe contrast function 
M(x,y) is determined only by fringe contrast (camera and projection system 
focusing), so that the M(x,y) function is a constant during inspection of 
different objects provided that the projected system is the same. Therefore, 
the method provides that function M(x,y) be preliminary measured, thereby 
allowing the elimination of an unknown in the equation (3) which thereafter 
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id(x>y)-h(*>y) 

I a (x,y)-I c (x,y) 



(8) 



reads as follows: 

l(x,y) = R{x,y)[l + M{x,y)>Cos(<p(x,y))] (9) 

[028] Therefore, the method of the present invention provides dealing with only two 
unknowns (see Equation (9)), namely R(x,y) and <p(x,y), thereby making it 
possible to use only two images to calculate the phase. 

[029] For example, using two images I a {x,y) and I c {x,y) that are shifted by n, the 

phase can be calculated as follow: 

I c (x,y)=R(> 
<p{x,y) = cos"' 

Although the above example is based on a phase-shifting of tt, the present 
method can be realized with any other phase-shifted value. Therefore, as 
illustrated in Figure 2 of the appended drawings, a method 10 consisting in 
performing an height mapping of an object according to an embodiment of 
the present invention comprises obtaining a first intensity characterizing said 
object, the object on which is projected an intensity pattern characterized by 
a fringe contrast function M(x,y), and the intensity pattern being located at a 
first position relatively to the object, (step 11); obtaining a second intensity 
characterizing said object, the object on which is projected the intensity 
pattern at a second position shifted from the first position, (step 13); 
calculating a phase value characterizing the object using said intensities and 
said fringe contrast function M(x,y); (step 14); obtaining the height mapping 
of the object by comparing the phase value to a reference phase value 



x, y)[\ + M{x, y) ■ Cos(<p(x, y))\ 
:, y)-[l + M(x, y) ■ Cos(<p(x, y) + x)] 

I a (x,y)-I c (x,y) 1 



I a (x,y)+I c (x,y) M{x,y)_ 



(10) 
(11) 
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associated to the reference surface (step 15). In particular, the height 
mapping z(x 9 y) can be computed using equation (6). 

[030] The measurement of the M(x,y) distribution can be performed during 
calibration of the measurement system 20 or by acquiring additional intensity 
values. For example, by acquiring the four intensity relations of equation (7) 
for an object, M(x, y) can be easily calculated. 

[031] The phase value that corresponds to a reference surface can be obtained by 
performing steps 11 to 14 for a reference object. It will be obvious for 
someone skilled in the art that this reference object can also be the object 
itself inspected at an earlier time, a similar object used as a model, or any 
kind of real or imaginary surface. 

[032] Persons skilled in the art will appreciate that the method of the present 
invention, by using only two images instead of at least three of them, allows 
for a faster acquisition and therefore for a faster object inspection. However, 
they will also appreciate that if, additional images are acquired, they can be 
advantageously used to increase the precision and the reliability of the 
method. By acquiring, for example, three or more images, it is possible to 
select among them the ones that are the more appropriate to perform the 
object height mapping. This way it is possible to discard according to a given 
criteria images or portions of images. For example, noisy pixels can be 
discarded and therefore the reliability of the method is improved. 
Alternatively, more than two intensity values can be used to compute the 
phase, that way improving the precision of the measurements 

[033] Turning now to Figures 3 and 4, a system 20 for performing a height 
mapping of the object, according to an embodiment of the present invention, 
is shown. In Figure 3, a pattern projection assembly 30 is used to project 
onto the surface 1 of the object 3 an intensity pattern having a given fringe 
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contrast function M(x,y). A detection assembly 50 is used to acquire the 
intensity values that have been mathematically described by equation (10). 
The detection assembly 50 can comprise a CCD camera or any other 
detection device. The detection assembly 50 can also comprise the 
necessary optical components, known to those skilled in the art, to relay 
appropriately the projected intensity pattern on the object to the detection 
device. The pattern projection assembly 30 is projecting the intensity pattern 
at an angle 6 with respect to the detection axis 41 of the detection assembly, 
where the angle 6 is the angle appearing in equation (2). The pattern 
projection assembly can comprises, for example, an illuminating assembly 
31, a pattern 32, and optics for projection 34. The pattern 32 is illuminated 
by the illuminating assembly 31 and projected onto the object 3 by means of 
the optics for projection 34. The pattern can be a grid having a selected pitch 
value, p. Persons skilled in the art will appreciate that other kinds of patterns 
may also be used. The characteristics of the intensity pattern can be 
adjusted by tuning both the illuminating assembly 31 and the optics for 
projection 34. The pattern displacement means 33 is used to shift, in a 
controlled manner, the pattern relatively to the object. The displacement can 
be provided by a mechanical device or could also be performed optically by 
translating the pattern intensity. This displacement can be controlled by a 
computer 60. Variants means for shifting the pattern relative to the object 
include displacement of the object 3 and displacement of the pattern 
projection assembly 30. 
[034] As illustrated in Figure 4, the computer 60 can also control the alignment and 
magnification power of the pattern projection assembly and the alignment of 
the detection assembly 50. Naturally the computer 60 is used to compute 
the object height mapping from the data acquired by the detection assembly 
50. The computer 60 is also used to store acquired images and 
corresponding phase values 61, and manage them. A software 63 can act 
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as an interface between the computer and the user to add flexibility in the 
system operation. 

[035] The above-described method 10 and system 20 can be used to map the 
height of an object with respect to a reference surface or to compute the 
relief of an object. They may also be provided for detecting defects on an 
object in comparison with a similar object used as a model or to detect 
changes of an object surface with time. In all cases, the above-described 
method 10 and system 20 can further include the selection of an appropriate 
intensity pattern and of an appropriate acquisition resolution that will be in 
accordance with the height of the object to be measured. 

[036] The above-described method 10 can naturally be applied in discrete steps in 
order to perform the height mapping of the object layer by layer. This 
technique -also called image unwrapping- enables one to measure the net 
object height mapping while keeping a good image resolution. 
The above-described method 10 and system 20 can also be used to 
determine the volume of an object or the volume of part of an object, since 
the object height mapping contains information, not only about the height of 
the object, but also about its length and width. This method can be 
advantageously applied, for example, in the semiconductor industry to 
determine the volume of some components parts that are under inspection 
such as, for example, connecting leads, and from that volume inferred the 
quality of the component part. 

[037] All the above presented applications of the invention can be used to further 
assess the quality of an object under inspection by comparing, when the 
object surface is inspected, the height mapping of the object to a reference 
height mapping, or, by comparing, when the object volume is under 
inspection, the volume of the object obtained from its height mapping to a 
know volume value. 

[038] The system 20 offers also the possibility to acquire an image of the object 
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corresponding to a situation where the object is illuminated without any 
pattern. This image, thereafter referred to as a unpattern image, can be 
obtained by adding the two intensities I a (x,y) and I c (x,y), I c (x 9 y) being 

phase-shifted by n with respect to I a (x,y). It will be obvious for someone 

skilled in the art that the unpattern image can also be obtained by acquiring 
other combination of intensities. This unpattern image can be used for 
example as a preliminary step in assessing the quality of an object or as an 
additional tool during the object inspection. 
[039] Although the present invention has been described hereinabove by way of 
specific embodiments thereof, it can be modified, without departing from the 
spirit and nature of the subject invention as defined herein. 
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